Papers by Hye Joo Han
OpenKorPOS: Democratizing Korean Tokenization with Voting-Based Open Corpus Annotation (2022.lrec-1)
Copied to clipboard
| Challenge: | Korean uses spaces at larger-than-word boundaries, unlike other East-Asian languages. |
| Approach: | They propose to use Korean morphological analyzers to provide a sequence of morpheme-level tokens, losing information in the tokenization process. |
| Outcome: | The proposed scheme improves existing tagging scheme and makes it friendlier to generative tasks. |